Engineering Technical Review Planning Briefing 


The general topics covered in the engineering technical planning briefing are 1) overviews of NASA, 
Marshall Space Flight Center (MSFC), and Engineering, 2) the NASA Systems Engineering(SE) Engine and 
its implementation , 3) the NASA Project Life Cycle, 4) MSFC Technical Management Branch Services in 
relation to the SE Engine and the Project Life Cycle , 5) Technical Reviews, 6) NASA Human Factor 
Design Guidance , and 7) the MSFC Human Factors Team. The engineering technical review portion of 
the presentation is the primary focus of the overall presentation and will address the definition of a 
design review, execution guidance, the essential stages of a technical review, and the overall review 
planning life cycle. Examples of a technical review plan content, review approaches, review schedules, 
and the review process will be provided and discussed. The human factors portion of the presentation 
will focus on the NASA guidance for human factors. Human factors definition, categories, design 
guidance, and human factor specialist roles will be addressed. In addition, the NASA Systems 
Engineering Engine description, definition, and application will be reviewed as background leading into 
the NASA Project Life Cycle Overview and technical review planning discussion. 
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•Engineering Planning and Technical Review Team Overview 
•Technical Reviews 
•Human Factors 
•Questions 
•Closing 







NASA Around the Country 
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Marshall has a key role in NASA’s mission 
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MSFC Overview 
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A Legacy of Science and Exploration 


Explorer I 


Apollo 
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Spacelab 


Space Shuttle 


Hubble Space 
Telescope 


Marshall continues its legacy of science and exploration. 



Marshall Space Flight Center (MSFC) 


•Marshall is one of NASA’s 10 field centers and works under the direction of headquarters 
in Washington, D.C. 

•The map shows the location and specialty of each center -- each with its own unique role 
in meeting the agency’s goals. 

•Marshall Space Flight Center is providing critical support in space transportation, space 
operations, and scientific research. 

•One of Marshall’s unique roles in the agency is the management of the Michoud 
Assembly Facility in New Orleans, Louisiana. 

•It’s a major space vehicle manufacturing and assembly facility and among the world’s 
largest manufacturing sites. 

•Michoud manufactured Saturn components, space shuttle external tanks and is ready to 
play a role in NASA’s new launch vehicles. 





From Exploration to Opportunity 


$2.88 billion (FY2009) 

impact to 

Alabama economy 


Nearly 6,000 employees 

(civil service and contractor, 
approximate number) 


3 rd largest employer 

in the Huntsville — Madison 


County area 


4.5 million square feet 

of space occupied 
in Huntsville 


2.2 million square feet 

of manufacturing space at 
IVEchoud Assembly Facility 


Marshall impacts the community. 



Marshall Space Flight Center (MSFC) 

Organization 


NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 

GEORGE C. MARSHALL SPACE FLIGHT CENTER 





Marshall’s Role in Space Exploration 



Understanding 
Our World 
and Beyond 


Living and'Working 
in Space 


Lifting from 
Earth 


Marshall mak 



Lifting from Earth - Exploration Program Destinations 






Mars < 

and Its 


Moons 

BeyoncTLEO - NASA’s 



Space Launch System 

Near-Earth » 



Asteroids 




Earth 

’s A 

n ™ 


Mooi 



Low Earth Orbit (LEO) 
- Commercial Space 
Transportation 



The need for flexible, evolvable and affordable systems. 





Lifting from Earth - The Space Launch System 


SLS - America’s Heavy Lift Rocket 


• Safe, affordable and sustainable 

• Carries the Orion Multi-Purpose Crew Vehicle (IVPCV) 

• Supports national missions beyond Earth orbit 

• Does not preclude back-up for ISS transportation 

• Initial lift capacity of 70 metric tons (rrt) evolving to 130 mt 

• Builds on Saturn, Shuttle and Ares 


Solid Rocket 
Motor Test 




Friction Stir 




Welding 


Shell Buckling 
Test 


Upper Stage 
J-2X Engine 


J-2X Engine 
Tests 


Core Stage 
RS-25 Engines 


Marshall's capabilities and facilities are 
launching the future of space vehicle development. 




Lifting from Earth 


130 mt 
389 ft. 


70 mt 
320 ft. 


Orion 

Multi-Purpose ■ 
Crew Vehicle 


Interstage- 


Solid 

Rocket 

Boosters 


Launch 

Abort 

System 





Core Stage 


il 


RS-25 

(Space Shuttle Main Engines) 


Payload 

Fairing 




Solid 

or 

Liquid 

Rocket 

Boosters 


INITIAL CAPABILITY, 2017-21 


EVOLVED CAPABILITY, Post-2021 


Flexible, Modular Configuration for Exploration Missions 
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Engineering Directorate, Spacecraft and 
Vehicle Systems Department, Systems 
Engineering and Integration Division 
Organization Overview 


•1 
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MSFC Engineering Directorate 


MARSHALL SPACE FLIGHT CENTER 

ENGINEERING DIRECTORATE 


ED01 



3 - 1013.55 

HS01 




The Spacecraft and Vehicle Systems Department 

Mission 


The Spacecraft and Vehicle Systems Department, Engineering 
Directorate, plans, performs and directs the technical Design, 
Analysis, Test, Evaluation, Verification, Integration, and Research & 
Development of the state of the art Spacecraft and Launch Vehicle 
Systems. 
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The Spacecraft and Vehicle Systems Department 


Organization 



Dynamics, Loads & Strength Branch (EV31) 
Structural & Mechanical Design Branch (EV32) 
Aerosciences Branch (EV33) 

Thermal Analysis & Control Branch (EV34) 
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Systems Engineering & Integration (SE&I) 

Division 
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Systems Engineering Definitions 


• Systems engineering is a methodical, disciplined approach for the design, 
realization, technical management, operations, and retirement of a system. 

• Systems engineering is the art and science of developing an operable system 
capable of meeting requirements within often opposed constraints. 

• Systems engineering is a holistic, integrative discipline, wherein the contributions of 
structural engineers, electrical engineers, mechanism designers, power engineers, 
human factors engineers, and many more disciplines are evaluated and balanced, 
one against another, to produce a coherent whole that is not dominated by the 
perspective of a single discipline. 


Reference: NASA/SP-2007-6105, NASA Systems Engineering Handbook 
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Systems Engineering Engine 
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NASA Systems Engineering (SE) Engine 


Requirements Flow Down 
from Level above 


Realized Products 
to Level above 



Requirements Flow Down 

to Level below 

••••••• ******* * •••••"• 

System Design Processes I 
applied to each WBS Model \ 
down and across 
system structure 


Figure 3-1 - SE Engine 


Realized Products 
from Level below 

\ Product Realization Processes 
applied to each product 
up and across 
system structure 

ilM Mill SIMM Mill III! Mill I 


NID 7123.69, NASA Systems Engineering Processes and Requirements 
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SE Engine Description 


• Contains core set of common technical processes and requirements to be used by NASA 
projects in engineering system products during the product life cycle. 

• The 17 common technical processes are enumerated according to their description in the 
NASA Interim Directive 7123_69, NASA Systems Engineering Processes and Requirements . 

• SE common technical processes model illustrates the use of: 

(1) The system design processes for —top down design of each product in the system 
structure 

(2) The product realization processes for —bottom up realization of each product in the 
system structure 

(3) The technical management processes for planning, assessing, and controlling the 
implementation of the system design and product realization processes. 

(4) Guide technical decision making (decision analysis) 
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SE Engine Definition 


The SE common technical processes model is referred to as an 

— SE engine: 

• To stress that these common technical processes are used to 
drive the development of the system products 

• To stress that these common technical processes are used to 
drive the development of associated work products required 
by management to satisfy the applicable product-line life- 
cycle phase exit criteria 

• While meeting stakeholder expectations within cost, 
schedule, and risk constraints. 




Application of SE Engine Processes within System 

Functions 


Requirements Flow Down 
from WBS Model above 
or from User 


Realized End Products 
to WBS Model above 
or to User 




Requirements Definition 
Processes 

1 Stakeholder Expectations 
Definition 

2 Technical Requirements 
Definition 


i 


Technical Solution 
Definition Processes 

3 Logical Decomposition 

4 Design Solution Definition 




Requirements Flow Down 
to WBS Models below or to 
Implementation Process 



Technical Planning 
Process 

10. Technical Planning 


Technical Control 
Processes 

1 1 . Requirements Management 

12. Interface Management 

13. Technical Risk Management 

14 Configuration Management 

15 Technical Data Management 

Technical Assessment 
Process 

16 Technical Assessment 

Technical Decision 
Analysis Process 
17. Decision Analysis 



Product Transition 
Process 

9. Product Transition 

T 

Evaluation Processes 

7. Product Verification 

8. Product Validation 

T 

Design Realization 
Processes 

5. Product Implementation 

6. Product Integration 



Realized End Products 
from WBS Models below or 
from Implementation Process 



Applied to 
Each WBS 
Model 


System Structure 


Top-Down 
System Design 


Bottom- up 
Product Realization 




Applied to 
Each WBS 
Model 


Figure 3-2 — Application of SE Engine Processes within System Structure 


NID 7123.69, NASA Systems Engineering Processes and Requirements 
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SE and the Work Breakdown Structure Models 


The common technical processes are used to define the WBS models of 
the system structure in each applicable phase of the relevant product- 
line life cycle to generate work products and system products needed 
to satisfy the exit criteria of the applicable phase. System engineering 
continues well into the operations and maintenance phase of a project, 
i.e., after the system products are delivered. 
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NPR 7120. 5E, NASA Space Flight Program and Project Management Requirements 
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Engineering 
Planning and 
Review Team 


Cross Cutting 
Team 


Risk Team 
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Technical Management Branch Services 


•The Technical Management Branch provides systems design with the following products and services: 
•Multidiscipline leadership 

• Technical Guidance 

• Technical Planning 

•Production and maintenance of technical plans such as the SEMP and Development Plans for the 
program/proj ects 

• Management of communication across interfaces 

• Technical Plan Implementation Assessments 

•Milestone Technical Review Planning 

• Decision Process Support 
•Risk Management 
•Technical Performance Metrics 
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Engineering Planning and Review Team Services 


•Expertise 

o Technical and Review Plan Development and Maintenance 

o Drafting, negotiating, and baselining of technical plans such as a program or 
project’s Systems Engineering Management Plan (SEMP) 

o Mission Concept Review (MCR) Plan 

o Other Review plans (i.e., SRR, SDR, PDR, CDR, DCR, etc.). 
•Implementation of Plans 

o Review Plan direction, implementation, and coordination 
o Technical Plan Implementation Assessment 

•Administrative 

o RID Tool Support 
o Review and RID Tool Training 

o RID Tool Account maintenance during program reviews 
o Track and monitor RID review process to assure closure of open RIDs 
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Technical Review Definition 


•A technical review is an evaluation of the project, or element thereof, by a knowledgeable group for 
the purposes of: 

a. Assessing the status of and progress toward accomplishing the planned activities. 

b. Validating the technical tradeoffs explored and design solutions proposed. 

c. Identifying technical weaknesses or marginal design and potential problems (risks) and 
recommending improvements and corrective actions. 

d. Making judgments on the activities’ readiness for the follow-on events, including additional 
future evaluation milestones to improve the likelihood of a successful outcome. 

e. Making assessments and recommendations to the project team, Center, and Agency 
management. 

f. Providing a historical record that can be referenced of decisions that were made during 
these formal reviews. 

g. Assessing the technical risk status and current risk profile. 

Reference: NID 7123.69, NASA Systems Engineering Processes and Requirements 31 




Technical Review Execution Guidance 


•The technical team shall execute the required technical review in accordance with the review 
entry and success criteria guidance in governing documentation. 

•Reviews are considered complete when the following are accomplished: 

a. Agreement exists for the disposition of all Review Item Discrepancies (RIDs) and 
Request for Actions (RFA). 

b. The review board report and minutes are complete and distributed. 

c. Agreement exists on a plan to address the issues and concerns in the review board’s 
report. 

d. Agreement exists on a plan for addressing the actions identified out of the review. 

e. Liens against the review results are closed, or an adequate and timely plan exists for 
their closure. 

f. Differences of opinion between the project under review and the review board(s) have 
been resolved, or a timely plan exists to resolve the issues. 

g. A report is given by the review board chairperson to the appropriate management and 
governing program management committees (PMCs) charged with oversight of the 
project. 

h. Appropriate procedures and controls are instituted to ensure that all actions from 
reviews are followed and verified through implementation to closure. 


Reference: NID 7123.69, NASA Systems Engineering Processes and Requirements 
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Entrance and Success Criteria 

Reference: NID 7123.69, NASA Systems Engineering Processes and 

Requirements 


Tabh 


G-7 — PDR Entrance and Success Criteria 


1 Preliminat y Design. Review 

1 

| Entrance Criteria 

Success t-Titeri-i j£] 


Successful corop letion of the SE>R or MDR axtd responses 
mnde to nil SDR or MDR RPAs and RJDs, oar a timely 
closure plan exists for those remaining open. 

A preluuiua3r\. r PDR agenda, success criteria. and charge 
to tribe board have been agreed to by' tine technical team, 
project manager, -and review chair prior to the PDR 
PDR te c htii c a 1 pro doc ts listed below for la oth hardware 
and 5 o ftwa re system elements have been made available 
to the cognizant participants prior to the review: 

a. Updated baselined documentation, as required. 

b. ^reliniinary' subsystem design specifications for each 
configuration item (hardware and software), with 
supporting trade-off analyses and data, as required. 
The pre liminar^ 1 ' software design, specification should 
include a completed definition of the software 
architecture and a preliminary database design 
description- as applicable. 

e Updated technology development maturity 

asse s snient p lan. 

d. Updated risk assessment and mitigation. 

e. Updated cost and schedule data. 

f_ Updated logistics documentation, as required 

g. Applicable technical plans f e . g _ _ technical 

performance measurement plan, contamination 
control plan, parts management plan, environments 
control plan. 1R Tv TT TFTR T c~ : control plan, payload-to- 
carrier integration plan. 

produ cibil ityV m anufac turability program plan, 
reliability" program, plan, equality" assurance plan). 
h_ Applicable standards, 

a. Safety analyses and plans. 

j_ Engineering drawing tree, 

k Interface control documents. 

l. Verification/validation phn. 

m. Plans to respond to regulatory requirements (e. g. = . 
Environmental Impact Statement), as required. 

n_ Disposal plan. 

o. Technical resource utilization estimates and margins. 

p. System-level safety analysis. 

q Preliminary limited life items list {TILTH. 


1. The top-level requirements including 

mission success criteria, TPMs, and any 

sponsor-imposed constraints are agreed 

upon, finalized, stated clearly, and 
consistent with the prelirninary design. 

A. The flow down of ve ri £i a b le requirements is 
c ornp lete and proper or. if not. an adequate 
plan exists for timely resolution of open 
items. Requirements are traceable to 
mission goals and objectives. 

3. The preliminary design is expected to meet 
the requirements at an acceptable level of 
risk- 

dr. Definition o f the technical interfaces is 
consistent with the overall technica 1 
maturity and protides an acceptable level of 
risk . 

5. Adequate technical interfaces are consistent 
with the o ferall technical maturity 7 and 
provide an acceptable level of risk. 

■&_ Adequate technical margins exist with 
respect to TPMs. 

7. Any required new technology has been 

developed to an a dequate state of readiness, 
or back-up options exist and are supported 
to make them a viable alternative. 

& _ The project risks are understood and have 
been credibly assessed, and plans, a 
process, and resources exist to effecthiely 
manage them. 

*?■_ Safety" and mission assurance (e_ g safety, 
reliability-', ma inta in ab i li try _ equality", and 
EEE p arts) have been adequately addressed 
in preliminary designs and any' applicable 
S At I vLA, products H£e.g_, TITA. system safety" 
analysis, a ltd failure modes and effec ts 
analysis) have been approved. 

IQ. The operational concept is technically 

sound, includes (where appropriate) human 
factors, and includes the flow down of 
reqnirements for its execution. 




Technical Review Stages 


Review Planning 
Checkpoint 

Review Logistics and Preparation (Includes Training) 

Kickoff 

Review Execution 
Reporting to Management 

Review Item Discrepancy ( RID) Burndown/RID Dispositioning 
Process 


Review Complete 




Review Planning Life Cycle 




10 Months 



18 Months 

2 Months 




6 Months 


16 Weeks 


16 Weeks 

8 Weeks 

6 Weeks 


1 Week 

1 Week 


4 Weeks 


20 Weeks 



Development Phase 

Execution Phase 

Ooseout Phase 

Features 

Planning Stage 

Checkpoint Stage 

Preparation Stage 

Review Stage 

Pre- Board Stage 

Board Stage 

Reporting Stage 

Bumdown Stage 

A 

AT 

L J 

p Plan Co 

1 L 

mpJete Check 

L A 

point Kid 

L < 

Loff Dispositions 

> 1 

; Complete Pre 6 

t 

oard Boa 

A 

rd CK 

L • 

*C Review Complete 

Objectives 

• Develop and approve 
Milestone Review Plan 

• Determine readiness to 
proceed to the review 

• Finalixe review plans 

• Compile data package 

• Prepare for Kickoff 

• Hold Kickoff 

• Generate, screen & 
disposition RIDs 

• Hold Preboard to 
disposition RIDs and 
decide if criteria met 

• Hold Board to 
disposition RIDs and 
determine Go/No-go 

• Report review 
outcomes to external 
stakeholders 

• Conduct activities to 
dose RIDs 

• Improve Process 

Primary 

Participants 

• PM | Decision Makers) 

• CE/LSE 

• Product Developers 

• Checkpoint Board 

• Product Developers 

• Review Teams 

• Board & Preboard 

• SRB 

• Product Developers 

• Review Teams 

• Screening Teams 

• SRB 

• RID Sponsors 

• Pre-Board 

• SRB 

• RID Sponsors 

• Board 

• SRB 

• PM 

• CE 

• PMC 

• CMC 

• Actionees 

Primary 

Activities 

• Determine Plan 
Parameters 

• Baseline the Plan 

• Provide data item status 

• Conduct Dry Run 

• Conduct Checkpoint 

• identify Participants 

• Deliver Documents 

• Participant Training 

• Conduct Dry Run 

• Conduct Kickoff 

• Revew Documents 

• Write Pre-RIDS 

• Conduct Tabletops 

• Conduct Screening 

• Define Impacts 

• Develop Dispositions 

• Conduct Dry Run 

• Conduct Pre-Board 

• Conduct Dry Run 

• Conduct Board 

• Prepare Review Report 

• Deliver External 
Briefings 

• Conduct PAL Sessions 

• RID Closure Activity 

• Revise Review Plan for 
As-run 

Primary 

Products 

• Program Decision Memo 

• Rewew Plan 

• ToA 

• Checkpoint Plan 

• Checkpoint Package 

• Go/no-go decision 

• Checkpoint Actions 

• Training Package 

• Data Package 

• Pre -Declared RlDs 

• Kickoff Presentation 

• Kickoff Actions 

• Pre-RJDs 

• Tabletop Schedule 

• RIDs 

• Pre board Presentation 

• Approved RIDs 

• Preboard Decisions / 
Minutes / Actions 

• Board Presentation 

• Approved RIDs 

• Board Decisions/ 
Minutes / Actions 

• Review Report / 
Presentations 

• RID Closure Data 

• As-run Review Plan 

Support 

Participants 

• Review Director 

• Plan Doc Owner 

• Data Mgmt. Support 

• IT Support 

• Review Director 

• RID Coordinator 

• Data Mgmt. Support 

• logistics Support 

• IT Support 

• Review Director 

• RID Coordinator 

• Data Mgmt. Support 

• logistics Support 

• IT Support 

• Review Director 

• RID Coordinator 

• Data Mgmt. Support 

• logistics Support 

• IT Support 

• Review Director 

• RID Coordinator 

• Data Mgmt. Support 

• logistics Support 

• fT Support 

• Review Director 

• RID Coordinator 

• Data Mgmt. Support 

• logistics Support 

• IT Support 

• Review Director 

• Data Mgmt. Support 

• logistics Support 

• Review Director 

• RID Coordinator 

• Data Mgmt. Support 

Support 

Activities 

• Establish Core Team 

• Conduct CT Logistics 

• Derelop Plan Inputs 

• Conduct Tabletop 

• Manage Change Pig 

• Plan Review logistics 

• Prepare Checkpoint 

Package 

• Conduct IT Logistics 

• Traei Support Staff 

• Plan Kickoff Logistics 

• Prepare Kickoff 
Presentation 

• Conduct Kickoff logistics 

• Conduct Review 
logistics 

• Provide Review Support 

• Plan Pre-Board logistics 

• Prepare Preboard 
Presentations 

• Conduct PB logistics 

• Provide PB Support 

• Plan Board logistics 

• Prepare Board 
Presentations 

• Conduct Board logistics 

• Prepare Pause & learn 
Presentations 

• Compile lessons 
learned 

• Make improvements to 
RID tool 

• Prepare As-Run Plan 

• Manage Change Pkg 

• Track RID Burndown 

Support 

Products/ 

Services 

• Core Team Wiki 

• Plan Change Package / 
Presentations 

• CP Dropped item Q lut 

• CP Distro lists/ Invites 

• CP Portal / Orop Box 

• Product QA Checklist 

• KO Distro lists /Invites 

• KO Badges/ S*n-in 

• KO A/V Services 

• KO Graphics Services 

• KO Facilities Services 

• KO Borrowed Items list 

• KO Food Services 

• Distro lists/ Invites 

• Badges/ Sign-in 

• A/V Services 

• Facilities Services 

• Borrowed Items list 

• Food Services 

• PB Distro lists / Invites 

• PB Badges/ Sign-in 

• PB A/V Services 

• PB Graphics Services 

• PB Facilities Services 

• PB Borrowed Items lot 

• PB Food Services 

• Bd Distro Usts/ Invites 

• Bd Badges/ Sign-m 

• Bd A/V Services 

• Bd Graphics Services 

• Bd FaoAties Services 

• Bd Borrowed Items List 

• Bd Food Services 

• lessons learned 

• RIO Tool enhancements 

• Plan Change Package / 
Presentations 
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Example Table of Contents for a Technical Review 

Plan 


INTRODUCTION 
Purpose 
Scope 

Change Authority/Responsibility 
DOCUMENTS 
Applicable Documents 
Reference Doc uments 

MILESTONE REVIEW RROGESS 
Prepare for Review 
Establish Review Schedule 
Defi ne Compliance Strategy 
Define Data Package 

Identify Review Participants 1 

T re ining 1 

Assess Readiness 1 

Cond uct Kic koff 1 

Assess Success Criteria 1 

Execute R I ED P rocess 1 

Cond uet Pre-Board *1 

Cond uct Board 

Review Completion 1 

REVIEW RESPONSIBILITIES 1 

Review Director 1 

RID Coordinator “1 

Pre-Board/Board Secretariat *1 

Document Developers 1 

Review Team s 1 

Review Team Leeds 1 

Review Team Members “1 

S c re ening Gommi ttees 1 

Pre-Board 1 

Board 1 

RID Actionee 1 

REVIEW ITEM DISCREPANCY OVERVIEW 1 

RID Processing 1 

Identify RIDs 1 

Go n duct Tabletop Sessions “1 

Gond uct Screening Activity 1 

Assess RID I m pacts 20 

RID Disposition 20 

Rre-Boerd/Boerd Disposition 20 

G lose RIDs 2 1 

Recleme Rrocess 23 

RID Criteria 23 

RID Rules 23 

RID Disposition 24 

FRID Too I 3 
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Example Table of Contents for a Technical Review 

Plan ( Continued) 


APPENDIX 

APPENDIX A ACRONYMS AND ABBREVIATIONS AND GLOSSARY OF TERMS 20 
A1 .O Acronyms and Abbreviations 20 

A2.0 Glossary of Terms 28 

APPENDIX B OPEN WORK 29 

B 1 O To Be Determined 29 

B2.0 To Be Resolved 30 

APPENDIX C SYSTEM REQUIREMENTS REVIEW (SRR)/SYSTEM DEFINITION REVIEW (SDR) 
Cl .O Overview 31 

02.0 Scope 31 

03.0 Review Web Site 31 

0-4.0 Schedule 32 

05.0 Entrance and Success Oriteria 32 

00.0 Review Data Rackage 48 

07.0 Review Positions 53 

08.0 Review Team 53 

09.0 Screening Committee Membership 55 

010.0 Rre-Board Membership 50 

011.0 Board membership 57 

ARRENDIX D PRELIMINARY DESIGN REVIEW (RDR) 58 

D 1 . 0 Scope 58 

D2.0 Review Web Site 58 

D3.0 Schedule 58 

D4.0 Entrance and Success Oriteria 58 
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TABLE B 1 -1 
TABLE B2-1 
TABLE 04-1 . 
TABLE 05-1 . 
TABLE 05-2. 
TABLE 05-3. 
TABLE 05-4. 
TABLE 05-5. 
TABLE 05-0. 
TABLE 05-7. 
TABLE 00-1 . 
TABLE 00-2. 
TABLE 00-5. 
TABLE 08-1 . 
TABLE 08-2. 
TABLE 09-1 . 
TABLE 010-1 
TABLE 011-1 
TABLE D4-1 . 
FIGURE 
FIGURE 3-1 . 
FIGURE 5-1 . 
FIGURE 5-2. 
FIGURE 5-3. 


TO BE DETERMINED ITEMS 29 

TO BE RESOLVED ISSUES 30 

SRR/SDR SOHEDULE FOR STER ONE OF THE SRR/SDR 32 

R/SRR ENTRANCE ORITERIA 33 

R/SDR ENTRANCE ORITERIA 34 

SRR ENTRANCE ORITERIA 30 

SDR ENTRANCE ORITERIA 37 

SUCCESS ORITERIA OATEGORV MATRIX 40 

SRR/SDR SUCCESS ORITERIA MATRIX (SOM) 43 

VS AD SURRORTING DOCUMENTS 48 

SRR/SDR DATA PACKAGE BASELINED/TO BE BASELINED BEFORE THE REVIEW 
SRR/SDR DATA PACKAGE TO BE BASELINED AFTER THE REVIEW 50 
SRR/SDR DATA RACKAGE REFERENCE DOCUMENTS 52 

SRR/SDR REVIEW TEAM 54 

SRR/SDR REVIEW TEAM 54 

SCREENING COMMITTEE MEMBERSHIR 55 

. RRE-BOARD MEMBERSHIR 50 

. BOARD MEMBERSHIR 57 

RDR SUCCESS CRITERIA MATRIX (SOM) 58 
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SLS ORGANIZATIONAL REVIEW TEAM TO SUCCESS ORITERIA MATRIX 
RID RROOESSI NG OVERVIEW 18 

R RE- BOA RD/BOARD DISPOSITION PROCESS 21 

RID CLOSEOUT PROCESS 22 
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Example Review Approach 


•Review is focused on the adequacy of the technical approach focused on 
the program and vehicle integration 

•MPR 7123.2A milestone success criteria and safety criteria are used to 
guide the assessment 

•Review teams addressed program and vehicle integration of the system 
requirements, design definition and safety by assessing each of the 
success criteria from their perspective 

•RIDs written against not meeting criteria - not against documents 




Example Team Approach 


• Discipline Review Teams 

> Organized by functional teams 

> Review teams to represent the implementation of the program, technical and safety 
organizations 

> Review Team Leads and team members are independent of the program or project being 
reviewed 

> Review teams served as dispositioning team for RIDs originating or assigned to their team 

• Screening Committee 

> Led by Lead System Engineer 

> Membership included the review team leads 

• Pre-Board 

> Chaired by the Chief Engineer 

> Membership defined in Program/Project Review Plan or in a memorandum 

• Board 

> Chaired by the Program Manager 

> Membership defined in Program/Project Review Plan or in a memorandum 

> 
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Example Review Schedule 



Data Package Delivered 

2/1/2012 

2/1/2012 

Pre-declared RID Cutoff 

2/1/2012 

2/1/2012 

Data Package Available 

2/6/2012 

2/6/2012 

Kickoff Meeting 

2/15/2012 

2/16/2012 

Data Package Review 

2/16/2012 

2/23/2012 

Team Meetings 

2/16/2012 

2/23/2012 

Pre-RID Submittal 

2/16/2012 

2/26/2012 

Pre-RID Cutoff 

2/26/2012 

2/26/2012 

Tabletop Meetings (discuss Pre-RIDs) 

2/27/2012 

3/6/2012 

RID Integrated Screening 

2/29/2012 

3/8/2012 

Document Developer/Actionee Response 

3/9/2012 

3/12/2012 

RID Disposition Meetings 

3/13/2012 

3/19/2012 

Pre-Board Preparation 

3/20/2012 

3/23/2012 

Pre-Board 

3/26/2012 

3/27/2012 

Board Preparation 

3/28/2012 

3/28/2012 

Board 

3/29/2012 

3/29/2012 



Example Review Process 


KICK-OFF 



DATA 

PACKAGE 

REVIEW 



REVIEW TEAM 
MEETINGS 



CRITERIA 
TABLE TOP 
MEETINGS 


r ^ 

PRE-BOARD 

♦ 

RID 

DISPOSITION 

MEETINGS 

* 

■ ■ 

RID IMPACT 
ASSESSMENT 
MEETINGS 

♦ 

SCREENING 

MEETINGS 

j 




- 


! 


BOARD 

* 

r ^ 
RID CLOSURE 

L. 1 
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NASA Systems Engineering Handbook Human 

Factors Definition 


Human factors engineering is the discipline 
that studies the human-system interfaces and 
provides requirements, standards, and 
guidelines to ensure the human component of 
the integrated system is able to function as 
intended. 
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Four Categories of Human Factors 


• The first is anthropometry and biomechanics — the physical size, shape, and strength 
of the humans. 

• The second is sensation and perception — primarily vision and hearing, but senses 
such as touch are also important. 

• The environment is a third factor — ambient noise and lighting, vibration, temperature 
and humidity, atmospheric composition, and contaminants. 

• Psychological factors comprise memory; information processing component such as 
pattern recognition, decisionmaking, and signal detection; and affective factors — 
e.g., emotions, cultural patterns. 


Reference: NASA/SP-2007-6105 
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Human Factors Engineering in the System 

Design Process 


•Stakeholder Expectations 
•Requirements Definition 

□ NASA-STD-3001 , NASA SPACE FLIGHT HUMAN SYSTEM STANDARD 
VOLUME 1: CREW HEALTH 

□ NASA-STD-3001, NASA SPACE FLIGHT HUMAN-SYSTEM STANDARD 
VOLUME 2: HUMAN FACTORS, HABITABILITY, AND ENVIRONMENTAL HEALTH 

□ NAS A/S P-20 10-3407, HUMAN INTEGRATION DESIGN HANDBOOK (HIDH) 
•Technical Solution 

•Usability Evaluations of Design Concepts 
•Verification 

Reference: NASA/SP-2007-6105 




What does a Human Factors Specialist do at NASA? 


The human factors specialist supports the systems 
engineering process by representing the users’ and 
maintainers’ requirements and capabilities throughout 
the design, production, and operations stages. 


Reference: NASA/SP-2007-6105 




Human Factor Specialist Roles 


•Identify applicable requirements based on Agency standards for human-system integration during the requirements definition 
phase. 

•Support development of mission concepts by providing information on human performance capabilities and limitations. 

•Support task analysis and function allocation with information on human capabilities and limitations. 

•Identify system design features that enhance usability. This integrates knowledge of human performance capabilities and design 
features. 

•Support trade studies by providing data on effects of alternative designs on time to complete tasks, workload, and error rates. 
•Support trade studies by providing data on effects of alternative designs on skills and training required to operate the system. 
•Support design reviews to ensure compliance with human-systems integration requirements. 

•Conduct evaluations using mockups and prototypes to provide detailed data on user performance. 

•Support development of training and maintenance procedures in conjunction with hardware designers and mission planners. 
•Collect data on human-system integration issues during operations to inform future designs. 


Reference: NASA/SP-2007-6105 
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MSFC Human Factors Team 


• This team is the discipline center of expertise at Marshall. 

• The team's specialties are worksite design, usability, and human modeling. 

• The team has mockup development and use expertise, as well as CAD- 
based simulation. 

• We create human:systems interaction requirements, identify verification 
methods, and complete verification. 
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•MSFC HFE deals with a broad range of human 
interface design considerations 


• Worksite design 

• Work, reach, & visual envelopes 

• Lighting 

• Tools & support equipment 

• Human:Computer Interaction 

• Displays design 

• Usability testing 

• Human:Robotic Interaction 

• Effects of special space environments 

• Vibration (during launch) 

• Weightlessness 

• Ability to perform work tasks 

• Habitability; not strictly HFE, but is system-level HF 


•4 
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•Tools 




• Wood, foamcore, plastic, metal 

• Fidelity appropriate to information needed 

• Typically, higher as design matures 

Human modeling 


Ares rocket Upper Stage 
instrument unit: wood 


•Motion capture: simple 
task analysis 


Neutral buoyancy 


Motion capture 








•History 





•Recent 



International Space Station 

• Module design for crew use: similar to Skylab design work 

• Physical design for experiments (payloads) and 
subsystems, such as life support 

• For operation and maintenance 

• EVA design 

Constellation (moon program) 

• Worksite design for ground crews assembling Ares rocket 

• Vibration effects on astronaut task performance 

Deep-space habitability studies 
Single-person spacecraft studies 


•FlexCraft 




NASA Community of Practice Human Factors Link 


https://nen.nasa.gov/web/hf 







Closing Remarks 
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